Continuous Sign Language Recognition and Its Translation into Intonation-Colored Speech

نویسندگان

چکیده

This article is devoted to solving the problem of converting sign language into a consistent text with intonation markup for subsequent voice synthesis phrases by speech intonation. The paper proposes an improved method continuous recognition language, results which are transmitted natural processor based on analyzers morphology, syntax, and semantics Kazakh including morphological inflection construction model simple sentences. approach has significant practical social significance, as it can lead development technologies that will help people disabilities communicate improve their quality life. As result cross-validation model, we obtained average test accuracy 0.97 val_accuracy 0.90 evaluation. We also identified 20 sentence structures intonational model.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Increasing adaptability of a speech into sign language translation system

This paper describes a new version of a speech into sign language translation system with new tools and characteristics for increasing its adaptability to a new task or a new semantic domain. This system is made up of a speech recognizer (for decoding the spoken utterance into a word sequence), a natural language translator (for converting a word sequence into a sequence of signs belonging to t...

متن کامل

Sign Language Recognition and Translation with Kinect

Sign language (SL) recognition, although has been explored for many years, is still a challenging problem for real practice. The complex background and illumination conditions affect the hand tracking and make the SL recognition very difficult. Fortunately, Kinect is able to provide depth and color data simultaneously, based on which the hand and body action can be tracked more accurate and eas...

متن کامل

Spoken Language Processing Techniques for Sign Language Recognition and Translation

We present an approach to automatically recognize sign language and translate it into a spoken language. A system to address these tasks is created based on state-ofthe-art techniques from statistical machine translation, speech recognition, and image processing research. Such a system is necessary for communication between deaf and hearing people. The communication is otherwise nearly impossib...

متن کامل

Continuous Sign Language Recognition – Approaches from Speech Recognition and Available Data Resources

In this paper we describe our current work on automatic continuous sign language recognition. We present an automatic sign language recognition system that is based on a large vocabulary speech recognition system and adopts many of the approaches that are conventionally applied in the recognition of spoken language. Furthermore, we present a set of freely available databases that can be used fo...

متن کامل

Improving Continuous Sign Language Recognition: Speech Recognition Techniques and System Design

Automatic sign language recognition (ASLR) is a special case of automatic speech recognition (ASR) and computer vision (CV) and is currently evolving from using artificial labgenerated data to using ’real-life’ data. Although ASLR still struggles with feature extraction, it can benefit from techniques developed for ASR. We present a large-vocabulary ASLR system that is able to recognize sentenc...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Sensors

سال: 2023

ISSN: ['1424-8220']

DOI: https://doi.org/10.3390/s23146383